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Abstract 

Background: Internet-based cognitive behavioural therapy (iCBT) is an effective and acceptable treatment for depression, 
especially when it includes guidance, but its treatment adherence has not yet been systematically studied. We conducted a 
meta-analysis, comparing the adherence to guided iCBT with the adherence to individual face-to-face CBT. 

Methods: Studies were selected from a database of trials that investigate treatment for adult depression (see www. 
evidencebasedpsychotherapies.org), updated to January 2013. We identified 24 studies describing 26 treatment conditions 
(14 face-to-face CBT, 12 guided iCBT), by means of these inclusion criteria: targeting depressed adults, no comorbid somatic 
disorder or substance abuse, community recruitment, published in the year 2000 or later. The main outcome measure was 
the percentage of completed sessions. We also coded the percentage of treatment completers (separately coding for 100% 
or at least 80% of treatment completed). 

Results:\Ne did not find studies that compared guided iCBT and face-to-face CBT in a single trial that met our inclusion 
criteria. Face-to-face CBT treatments ranged from 12 to 28 sessions, guided iCBT interventions consisted of 5 to 9 sessions. 
Participants in face-to-face CBT completed on average 83.9% of their treatment, which did not differ significantly from 
participants in guided iCBT (80.8%, P = .59). The percentage of completers (total intervention) was significantly higher in 
face-to-face CBT (84.7%) than in guided iCBT (65.1%, P < .001), as was the percentage of completers of 80% or more of the 
intervention (face-to-face CBT: 85.2%, guided iCBT: 67.5%, P = .003). Non-completers of face-to-face CBT completed on 
average 24.5% of their treatment, while non-completers of guided iCBT completed on average 42.1% of their treatment. 

Conclusion: We did not find studies that compared guided iCBT and face-to-face CBT in a single trial. Adherence to guided 
iCBT appears to be adequate and could be equal to adherence to face-to-face CBT. 
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Introduction 

A growing number of self-help interventions for depression are 
available on the internet. Internet-delivered self-help programmes 
can be an effective treatment for depression [1,2]. These 
interventions can be roughly divided into guided and unguided 
interventions. Unguided interventions are fully automated self- 
help programmes without any therapist support, e.g. [3-5]. 
Guidance in guided self-help interventions is usually conducted 
via email by a therapist or coach, e.g. [6-8]. In contrast to a 
therapist, a coach does not need to be a licensed professional, but 
can also be a trained volunteer or a professional with lower levels 
of education. Guided internet interventions are generally consid- 
ered to be more effective in reducing depressive symptoms than 
unguided ones [2,9,10]. 



Most internet interventions for depression consist of internet- 
delivered cognitive behavioural therapy (iCBT), or related 
therapies, such as problem solving therapy [8,11], even though 
internet interventions might also be based on other therapeutic 
orientations, e.g. psychodynamic therapy [12]. Guided iCBT has 
proved to be an effective form of treatment for depression [1,2] 
and acceptable for both patients and professionals [13-15]. 
However, internet interventions can be associated with substantial 
attrition [16,17]. The attrition or adherence rates for guided iCBT 
for depression have not yet been systematically studied, while they 
are an important measure of acceptability and could be related to 
treatment outcome [18]. 

Attrition can be defined in a number of ways. Previous studies 
have discussed terms like therapy drop-out and premature 
discontinuation [19], premature termination [20], non-usage 
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attrition [21], (non-)persistence [22], and (non-)adherence [16]. 
Although all these terms describe the extent to which an individual 
completes the treatment, the definitions differ. For the present 
study, we will use the terms adherence and non-adherence to 
describe the extent to which individuals are exposed to the content 
of the intervention [16]. This can be operationalised by dividing 
the mean amount of completed sessions or modules by the 
maximum amount of sessions or modules. This definition can 
apply both to face-to-face treatment and internet-based treatment. 
We will add to this definition that participants allocated to an 
intervention who do not start the treatment should also be 
included in the non-adherence rate. There are two reasons for this 
addition. First, in randomised trials, it is important that all 
randomised participants are included in intention-to-treat analyses 
to preserve the unbiased comparison between groups allowed by 
randomisation [23]. Second, individuals who proceeded as far as 
allocation to a treatment can be regarded as having the intention 
to be treated. 

The first meta-analysis of non-adherence to psychotherapy in its 
traditional face-to-face setting showed that about 50% of those 
that started their treatment completed it [24]. However, in a new 
meta-analysis among more recently published studies (1990-2010), 
the percentage of completers was 80.3% [19]. Cognitive behav- 
ioural therapy (CBT) performed slighdy better than the general 
average (81.6%), as did therapies for patients with mood disorders 
(82.6%). It is important to note that both meta-analyses [19,24] 
included only participants who had started the intervention. 
Patients who did not show up for their first session were excluded 
from the analyses. Although the proportion of completers 
according to our definition would, therefore, be lower, it is 
evident that adherence to CBT for depression could be relatively 
high, which is further underlined by other studies [25]. 

To date, the adherence to guided iCBT for depression has not 
been systematically studied. With regard to computerised CBT (a 
broader definition than iCBT, for instance including a self-help 
course on CD-ROM) for depression, the drop-out rate averages 
31.75% [14]. However, the definition of drop-out was quite 
diverse among the sixteen studies in the review by Kaltenthaler 
[14] and comprised both non-adherence to treatment and non- 
response to follow-up measures. Waller and Gilbody [26] found 
that a median of 56% treatment starters completed a full course of 
computerised CBT. In their meta-analytic review, Richards and 
Richardson [2] found that adherence to computerised CBT was 
associated with type of guidance. Overall, the percentage of 
completers was 43%. For therapist-guided computerised CBT 
interventions, it was 72%, for administrative support 65.2% and 
for no support 26%. These rates of completion in computerised 
CBT cannot be easily generalised to guided iCBT. Computerised 
CBT may also include therapy sessions on CD-ROM or DVD, or 
on stand-alone computers in a clinical practice, and guidance may 
be given by face-to-face contact, telephone or email. iCBT 
programmes, on the other hand, are followed completely on the 
internet, and can be guided by email, chat or telephone. 
Additionally, meta-analyses and reviews to date have focused 
mainly on drop-out rates instead of the extent to which individuals 
are exposed to the content of the intervention. That is, it was not 
taken into account whether non-completers dropped out early on 
or nearly completed the intervention. 

In sum, guided iCBT is a promising treatment for depression, 
but to date, the overall adherence to this type of treatment is 
unknown. It is also unknown how the adherence to guided iCBT 
compares with face-to-face CBT for depression. The present study 
is a meta-analysis investigating the adherence to guided iCBT self- 



help interventions, and comparing these with adherence to 
individual face-to-face CBT interventions. 

Method 

Identification and selection of studies 

We used an existing database that is aimed to include all 
randomised trials of the psychological treatments of depression. 
This database has been described in detail elsewhere [27] and has 
been used in a series of meta-analyses (www. 
evidencebasedpsychotherapies.org). The extracted data are avail- 
able on request. The database contains studies from 1974 and has 
been continuously updated through comprehensive literature 
searches up to January 2013. In these searches, 14,164 abstracts 
were examined in PubMed (3638 abstracts), Psyclnfo (2824), 
Embase (4682) and the Cochrane Central Register of Controlled 
Trials (3020). The abstracts were identified by combining terms 
indicative of psychological treatment and depression, using both 
MeSH-terms and text words. Details of the search strings are 
presented in a previous study [27]. Some grey literature was 
included as well, such as PhD theses that contained material that 
had not been published elsewhere. Due to time constraints, further 
unpublished material was not searched for, and authors of studies 
describing incomplete data were not contacted. Non-randomised 
studies are also relevant when examining adherence, but were 
excluded. These are few in number and cannot be compared 
validly with randomised studies, because randomised allocation 
may have an effect on adherence. For the current study, previous 
reviews and meta-analyses of computerised CBT and face-to-face 
CBT for depression were also checked for additional studies. 

For the present meta-analysis, we included studies on CBT 
among depressed adults (18+ years), including student samples and 
elderly samples. 'Depressed' was defined as major or minor 
depressive disorder according to a diagnostic interview or an 
elevated level of depressive symptoms. Depressive symptoms could 
be indicated by a score above a cut-off point on a validated self- 
report depression scale like the Beck Depression Inventory. We 
only included trials in which at least one treatment group was 
offered guided iCBT or individual face-to-face CBT. CBT was 
defined as treatment in which cognitive restructuring is the core 
element, commonly based on the manual developed by Beck, 
Rush, Shaw & Emery [28], or treatment in which cognitive 
restructuring is an important component, but where components 
such as behavioural activation, social skills training, relaxation, or 
coping skills also have a prominent place. An example of the latter 
approach is the Coping with Depression course [29]. Guided 
iCBT was defined as internet-based self-help CBT that includes 
coaching or guidance by email, chat or telephone. Face-to-face 
CBT was defined as CBT delivered face-to-face by a therapist to 
an individual. When a study contained several treatment groups 
who were offered CBT or iCBT, these were coded as separate, 
independent groups. The selection of the studies was conducted by 
the first author. 

We excluded studies that examined CBT for patients with 
comorbid somatic conditions (e.g. diabetes) or addictions, and 
studies on relapse prevention. Also excluded were studies on CBT 
delivered by book (bibliotherapy), CD-ROM, email or telephone, 
unguided iCBT, studies in which the CBT intervention was 
combined with pharmacotherapy, and studies on group CBT. 
Group CBT was an exclusion criterion, because guided iCBT is 
individual and, therefore, more comparable with individual face- 
to-face therapy. To increase the comparability between studies on 
guided iCBT and studies on individual face-to-face CBT further, 
we also excluded studies based on publication year and 
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recruitment method. Research on iCBT emerged in the early 
2000s, so we excluded all studies that were published before the 
year 2000. Because participants in iCBT are often self-referred 
[26], we excluded studies on inpatients and only included studies 
that recruited their sample largely or entirely from the community, 
i.e. by means of advertisements in newspapers or magazines, 
banners on websites, or large scale mailings. 
No language restrictions were applied. 

Coding and data extraction 

The main outcome variable of our analyses was the average 
number of modules, lessons or treatment sessions (and standard 
deviation) that were completed by the participants, divided by the 
total number of sessions to obtain a proportion or percentage. In 
some cases, these values were not reported, but could be calculated 
based on the flow chart, or could be estimated. Estimates were 
conservative, expecting low adherence, to avoid overestimating the 
overall adherence rates. For example, a study could describe an 
intervention of eight sessions with one session every week, and 
report that two participants dropped out during the first four 
weeks. In that case, we considered these two participants to have 
completed one session. When possible, we created a data file 
containing the number of completed sessions for each participant 
in a particular study based on all information extracted from that 
particular paper. Means and standard deviations were then 
calculated using SPSS 19. The secondary outcome variables 
concerned the percentage of intervention completers, of which we 
coded both the 100% and 80% or more intervention completion 
rate. Studies on adherence usually focus on the amount of 
intervention completers, so we included these outcome measures 
for comparability with other studies. The 100% completion rate 
was defined as the number of participants who had completed all 
sessions or modules divided by the number of participants 
allocated to the intervention. We also coded the number of 
participants that had completed at least 80% of the intervention, 
i.e. 80% of the total number of sessions. These participants may 
not have completed the entire intervention, but were exposed to a 
substantial part of the treatment content. When the 80% 
treatment completion was not reported and could not be inferred, 
we analysed the number of participants who had completed 100% 
of the intervention for that study, because those are the 
participants of whom we can be sure to have completed at least 
80%. 

We included in our analyses all participants who had completed 
the pre-treatment measures and were allocated to a CBT 
condition, regardless of whether or not the participant started 
the intervention. In half of the included studies on face-to-face 
CBT, participants who had completed a substantial part of the 
intervention were defined as completers, for example participants 
who had completed at least twelve sessions of a twenty-session 
treatment protocol. In some of these cases, we were still able to 
estimate the adherence rates by using the respective authors' 
definition of completers. For these studies we still used the 
maximum amount of sessions, which is usually the number 
specified in therapy manuals, to calculate the proportion of 
sessions completed. When no other information was available, 
completers as defined by a study's authors were assumed to have 
completed the entire therapy protocol, i.e. for our analyses they 
were assumed to have completed the maximum amount of 
sessions. This assumption could overestimate adherence to face-to- 
face CBT. 

Data abstraction from the studies was conducted by two 
independent raters (WvB and EK). Differences were discussed 
until consensus was reached. 



Quality assessment 

The validity of included studies in meta-analyses is usually 
assessed, for example, by using criteria of the 'Risk of bias' 
assessment tool, developed by the Cochrane Collaboration [30]. 
This tool assesses possible sources of bias in randomised trials. In 
the current study, criteria pertaining to randomisation, allocation 
concealment and blinding of participants, personnel and outcome 
assessors were not assessed. These criteria were not relevant to our 
study, because we did not assess effectiveness or outcomes of the 
interventions. We assessed studies for the quality criterion 
pertaining to adequate dealing with incomplete outcome data. 
This involved examining whether all participants allocated to the 
intervention were included in the analyses and how missing data 
were analysed. We also coded whether rates of intervention 
adherence and study drop-out were reported. The quality 
assessment was conducted by two independent reviewers (WB 
and PC), and disagreements were resolved by discussion. 

Meta-analyses 

The heterogeneity between studies was calculated using the I - 
statistic. This f is expressed in percentages. A value of 0% 
indicates no heterogeneity, 25% indicates low, 50% indicates 
moderate, and 75% indicates high heterogeneity [31]. We also 
report the significance of the Q;Statistic, which indicates whether 
the heterogeneity was significant or not. Since we expected 
considerable heterogeneity, we decided to perform our analyses 
using a random effects model. In this model, the included studies 
differ not only because of the random error within studies (as in the 
fixed effects model), but also because of true variation from one 
study to the next. 

Each outcome measure was pooled in the subgroups face-to- 
face CBT and guided iCBT. We performed subgroup analyses to 
compare adherence rates between these groups. These analyses 
were conducted according to the mixed effect model. In this 
model, studies within subgroups are pooled with the random 
effects model, while tests for significant differences between 
subgroups are conducted with the fixed effects model. All analyses 
were performed with Comprehensive Meta-Analysis (CMA; 
version 2.2.021). 

Results 

Selection and inclusion of studies 

Having examined a total of 14,164 abstracts (10,474 after 
removal of duplicates), we retrieved 1,476 potentially relevant full- 
text papers for further consideration. We excluded 854 of the 
retrieved papers (studies with adolescents: 74; no random 
assignment: 56; included patients who were not depressed: 192; 
did not meet definition of psychotherapy: 173; no comparison 
group: 117; maintenance trial: 97; other reason, e.g. insufficient 
data, protocols, conference abstracts: 145). This resulted in a total 
of 351 papers on randomised psychotherapy trials of adult 
depression interventions. Twenty-four studies on individual face- 
to-face or guided internet-based CBT met inclusion criteria and 
were included in this study [6-8,32-52] (26 treatment groups; 14 
individual face-to-face CBT and 12 guided iCBT). See Figure 1 for 
a flow chart and the specific reasons for exclusion. None of these 
studies included both a guided iCBT condition and a face-to-face 
CBT condition. Baseline characteristics of face-to-face CBT 
groups and guided iCBT groups were comparable in terms of 
symptom severity. The mean baseline Beck Depression Inventory 
scores of face-to-face CBT groups ranged from 21.70 to 34.12 
(overall mean = 26.67), while these scores ranged from 19.70 to 
28.96 in guided iCBT groups (overall mean = 25.23). 
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14,164 references identified 
by literature search : 

- PubMed: 3,638 

- PsyclNFO: 2,824 

- Embase: 4,682 

- Cochrane: 3,020 



T 



After removal of duplicates: 
10.474 abstracts 



T 



1 .476 full-text papers 
retrieved 



351 papers on randomised 
trials of psychotherapy for 
adult depression (622 when 
including multiple papers on 
the same trial) 



24 papers included describing 
26 treatment conditions 

- 14 treatment conditions of 
face-to-face CBT 

- 12 treatment conditions of 
^guided iCBT 



Excluded: 854 

- Studies with adolescents (74) 

- No random assignment (56) 

- Not only depression (192) 

- No psychotherapy (173) 

- No comparison condition (117) 

- Maintenance trial (97) 

- Other reason (145) 



Excluded: 329 

- Published before 2000 (130) 

- Not on CBT (98) 

- No community recruitment (61) 

- Duplicates (1) 

- Somatic conditions, addictions (9) 
-Group CBT (18) 

- Bibliotherapy (3) 

- Unguided iCBT (8) 

- Telephone CBT (1) 



Two papers added by manual 
search. 



Figure 1. Flow chart of included studies. 

doi:1 0.1 371/journal.pone.01 00674.g001 



Characteristics of the included studies and treatment 
groups 

Six studies on iCBT were conducted in Europe (3 in Sweden, 1 
in Switzerland and Germany, 2 in the Netherlands), while 4 were 
conducted in Australia. Seven studies on face-to-face CBT were 
conducted in the United States, 2 in Canada, 2 in Germany, 1 in 
the United Kingdom, 1 in Switzerland and 1 in Romania 
(Table 1). All but 2 face-to-face studies performed intention-to- 
treat analyses and all but 2 studies reported the study drop-out rate 
or sufficient information to infer it (Table 1). 

The 26 treatment groups included in our analyses comprised 
98 1 participants who completed pre-treatment measurements and 
were allocated to CBT. Of these, 504 were allocated to face-to- 
face CBT and 477 to guided iCBT. One study, which was on face- 
to-face CBT, did not report the total number of participants who 



had completed pre-treatment measurements and were allocated to 
the treatment group. Therefore, this study could not be included 
in all of the analyses. In seven studies on face-to-face CBT 
[33,35,36,40-42,44] participants who had not completed the entire 
treatment but a predefined substantial part of it were considered 
completers. One study on guided iCBT [48] described an 
intervention that was individually tailored to the participant and 
could consist of 8 to 10 sessions. The percentage of completed 
sessions (mean and standard deviation) was not reported or could 
not be calculated for 14 groups (9 face-to-face, 5 iCBT). For 4 of 
these 14 groups (3 face-to-face CBT, 1 iCBT), these variables 
could be estimated, while it could not be retrieved for the other 10 
groups. The percentage of participants who completed 100% of 
their treatment was not reported for 5 groups (2 face-to-face, 3 
iCBT), while for 16 groups the percentage of participants who had 



PLOS ONE | www.plosone.org 



4 



July 2014 | Volume 9 | Issue 7 | e1 00674 



Meta-Analysis Adherence iCBT and FtF CBT 



a 
E 
o 



i/> E 



a 

|| 
u o 

z S 



a „ 

£ £ 

o o 

u o 

z — 



0J 
T3 
=3 



T3 
0) 

T3 
3 



IS 



5 S 



^- r-l »- 



i— *OC0C0*OC0vOv£>00 

















pq 


in 




a> 


rj 


LA 


si 




00 


LH 


in 




m 




ct; 








rn 


d 






fN 


rN 





cc 
z 






D 


CO 






rn 




fN 




o 

r< 


CO 


fN 

fN 



T- T- 00 



fN fN >JD fN fN fN 



<— m fN 



m <— i- 



t- o t- 



00 DO 00 DO 



00 00 CD 00 



— CO fN 



4- ^ 4- o -T -i r 



o<5 



D '2 4J 



a; o 



E 
b 



E E 



c S S 
£ | a. 
» E S 



o o 



2 o 

c <u 

2 £ -d 

c 2 Si -6 



£ -6 = o 

s S q- 

C O 3 

1 K 

.2 = 5 m 
■5 « .9- - 



; 5 »» 



PL0S ONE | www.plosone.org 



5 



July 2014 | Volume 9 | Issue 7 | e1 00674 



Meta-Analysis Adherence iCBT and FtF CBT 



completed 80% or more of the treatment was not reported (8 face- 
to-face, 8 iCBT). When the 80% completion rate was not 
available, but the 100% completion rate was, the 100% 
completion data was used. Otherwise, studies with incomplete 
data were not included in the analyses. 

Adherence 

We compared 7 groups of face-to-face CBT and 8 groups of 
guided iCBT in the analyses of the percentage of completed 
sessions (Figure 2). One study on face-to-face CBT was excluded 
from the analysis, because it had a mean completed session rate of 
100% with a standard deviation of 0% and could therefore not be 
analysed. Heterogeneity tests demonstrated significant heteroge- 
neity between studies (P < .001, overall f = 86.5%). Face-to-face 
CBT ranged in length from 12 to 28 sessions. The average 
percentage of completed face-to-face CBT sessions was 83.9% (CI 
75.7% - 92.1%). Guided iCBT interventions ranged in length 
from 5 to 10 sessions. On average, participants completed 80.8% 
of their treatments (CI 73.0% - 88.7%). The difference between 
the percentage of completed sessions for face-to-face CBT and 
iCBT was not statistically different (P = .59). See Table 2. 

In order to compare the percentage of participants who 
completed the entire intervention (100%), we included 11 face- 
to-face CBT groups and 9 iCBT groups in our analyses (Figure 3). 
There was significant heterogeneity between the studies (P < .001, 
I 2 = 78.4%). Of the participants in the face-to-face groups, 84.7% 
(CI 78.0% - 89.6%) completed the entire intervention. In the 
guided iCBT groups, this was 65.1% (CI 55.3% - 73.8%). The 
difference between these rates for face-to-face CBT and guided 
iCBT was statistically significant (P < .001; Table 2). 

Results of the 80% completion analyses, also based on 11 face- 
to-face CBT groups and 9 iCBT groups, were similar to the 100% 
completion analyses in terms of overall heterogeneity (P< .001, f 
= 79.3%). The percentage of completers of face-to-face CBT was 



85.2% (CI 78.1% - 90.4%), and the percentage of completers of 
guided iCBT was 67.5% (CI 56.8% - 76.6%). Again, this 
difference was statistically significant (P = .003). See Figure 4 and 
Table 2. 

Adherence of non-completers 

For 6 face-to-face CBT groups [34-37,40,43] and 8 iCBT 
groups [6-8,46,47,49,51], sufficient information was reported to 
calculate the adherence of non-completers. Non-completers of 
face-to-face CBT completed on average 24.5% of their treatment 
before discontinuing. Non-completers of guided iCBT, on the 
other hand, completed on average 42.1% of their treatment. 

Discussion 

In this meta-analysis, we examined the adherence to guided 
iCBT, and compared this with the adherence to individual face-to- 
face CBT. No studies were found that included both a guided 
iCBT and a face-to-face CBT treatment condition. We analysed 
98 1 participants, who were divided over 26 treatment groups and 
described by 24 studies. In the guided iCBT groups, participants 
completed on average 80.8% of their treatment, which did not 
differ significandy from the face-to-face CBT groups (83.9%). The 
percentage of treatment completers was higher in face-to-face 
CBT than in guided iCBT. Of all participants starting face-to-face 
CBT, 84.7% fully completed their treatment and 85.2% 
completed at least 80% of their treatment. These numbers were 
65.1% and 67.5% for guided iCBT, respectively, which is 
significandy lower. The discrepancy between these outcomes can 
be explained by the adherence of non-completers. Non-completers 
of guided iCBT followed on average 42.1% of their treatment 
programmes before they dropped out, while non-completers of 
face-to-face CBT followed 24.5% of their treatment programmes. 
It should be taken into account that guided iCBT interventions 
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Mean 


limit 


limit 


Total 


Constantino 2008 


FtF CBT 


0.8988 


0.8105 


0.9871 


11 


David 2008 


FtF CBT 


0.8875 


0.8153 


0.9597 


56 


DeRubeis 2005 


FtF CBT 


0.8554 


0.7676 


0.9432 


60 


Dimidjian 2006 


FtF CBT 


0.8713 


0.7743 


0.9683 


45 


McBride 2006 


FtF CBT 


0.8280 


0.7761 


0.8799 


37 


Serfaty2009 


FtF CBT 


0.5908 


0.5047 


0.6769 


70 


Teismann 2011 


FtF CBT 


0.9333 


0.8801 


0.9865 


34 






0.8392 


0.7571 


0.9212 




Andersson 2005 


guid. iCBT 


0.7400 


0.6414 


0.8386 


57 


Berger 2011 


guid. iCBT 


0.8520 


0.7399 


0.9641 


25 


Choi 2012 


guid. iCBT 


0.8214 


0.7051 


0.9377 


28 


Perini 2009 


guid. iCBT 


0.8883 


0.8122 


0.9644 


27 


Titov2010(l) 


guid. iCBT 


0.8833 


0.8052 


0.9614 


43 
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Figure 2. Meta-analysis of percentage of completed sessions, where the completed sessions (mean and sd) are divided by the total 
number of sessions. 
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Table 2. Meta-analyses of adherence to guided iCBT and individual face-to-face CBT. 







Guided iCBT (95% C.I.) 


FtF CBT (95% C.I.) 


P 


/*' 


Session completion 3 


80.8% (73.0% - 88.7%) 


83.9% (75.7% - 92.1%) 


.59 


86.5% 


Completers (total) b 


65.1% (55.3% - 73.8%) 


84.7% (78.0% - 89.6%) 


< .001 


78.4% 


Completers (a 80%) b 


67.5% (56.8% - 76.6%) 


85.2% (78.1% - 90.4%) 


.003 


79.3% 



a As percentage of the total number of sessions. 

b As percentage of all participants who were allocated to the treatment. 
c Overall heterogeneity (Q value) was significant for all analyses. 

Abbreviations: guided iCBT = guided internet-delivered cognitive behavioural therapy; FtF CBT = individual face-to-face cognitive behavioural therapy; C.I. = 

confidence interval. 
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consisted of 5 to 10 sessions, while face-to-face CBT treatments 
ranged from 12 to 28 sessions. 

To date, adherence rates are often expressed as the percentage 
of a sample that completed an intervention. Looking at this 
outcome only, our results show a difference between adherence to 
face-to-face CBT and adherence to guided iCBT. However, the 
percentage of completed sessions did not differ between face-to- 
face CBT and iCBT. The percentage of completed sessions may 
be a more accurate measure of adherence than the percentage of 
completers, because it gives insight into the adherence of all 
participants, including the non-completers. 

Adherence to iCBT - comparison with the literature 

Richards and Richardson [2] analysed computerised psycho- 
logical treatments for depression, of which several were iCBT 
interventions, and found a 65% completion rate for internet 



interventions with administrative support and 72% for those with 
therapist-support. Our finding that 65.1% of participants com- 
pleted the treatment is slighdy low in comparison with the study of 
Richards and Richardson, because we included in our analyses 
both iCBT groups guided by clinicians and iCBT groups with 
other guidance. Regarding the percentage of completed sessions, 
this has not been reported in previous reviews and meta-analyses 
[2,14]. Our finding that participants in guided iCBT groups 
completed on average 80.8% of their treatment therefore cannot 
be compared with any results in the previous literature. 

A different method of analysing drop-out and adherence to 
internet treatments for psychological disorders was applied in the 
review by Melville et al. [53], where drop-out rates were calculated 
at various points in the process of a study, maintaining the number 
of eligible participants as the denominator. It was found that 2 1 % 
of eligible participants drop out before commencing treatment and 
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Figure 3. Meta-analysis of percentage of completers of the entire intervention, where N completers is divided by the total N. 
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Figure 4. Meta-analysis of the percentage of participants who completed 80% of the sessions, where N completers (80%) is divided 
by the total N. 
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that the same percentage of eligible participants drop-out during 
the treatment [53]. Depressed mood may be a factor that 
decreases adherence [53], probably because lack of concentration 
and motivation are inherent to this condition. Arguably, this 
method of analysing drop-out and adherence is the most objective 
and complete, because it gives an overview of attrition in the entire 
research and intervention process. Adherence and drop-out rates 
according to this definition are difficult to review, however, 
because many studies do not supply sufficient information [53]. 

Factors associated with adherence to iCBT 

Factors that may explain adherence to internet interventions are 
related to guidance, study design, regularity of updates to the 
intervention website and persuasive technology (i.e. technology 
designed to include persuasion and social influence) [17]. With 
regard to studies on iCBT for depression, the use of persuasive 
technology and the regularity of updates is usually not reported. 
Concerning guidance and study design, previous literature does 
indicate that these factors may affect the adherence to iCBT for 
depression. Study design has proved to be an important factor, as 
adherence to treatment in randomised trials is high relative to 
adherence to open access websites [16]. Guidance is an important 
factor as well. As previously stated, therapist support leads to better 
adherence than administrative support in computerised CBT for 
depression, and both therapist and administrative support lead to 
better adherence than no support [2]. Previous studies have also 
shown that guided iCBT is more effective than unguided iCBT 
[1]. However, when directly comparing therapist support with 
administrative support in iCBT for depression, in the same trial 
and using the same intervention, the adherence rates hardly 



differed and there was no significant difference in clinical outcome 
or acceptability [6]. Similarly, directly comparing guided iCBT 
with unguided iCBT for depression, in the same trial and using the 
same intervention, differences in adherence and clinical effect were 
small to moderate and not significant [46] . The lack of a difference 
in clinical effect may be explained by the fact that participants in 
both arms of the study by Berger et al. had contact with the study 
team before the treatment started [9] . Both of these studies [6,46] 
may have been underpowered. On the other hand, these studies 
could indicate that differences in adherence and clinical effect are 
related to the recruited population (e.g. depression symptom 
severity at baseline) and/ or trial design, rather than the amount of 
guidance. More trials of such direct comparisons would be 
welcome, in order to gain more insight into the factors that explain 
adherence to iCBT for depression. 

It is often not reported why participants decided to discontinue 
their treatment. One study on unguided iCBT for depression 
suggested that drop-outs may have stopped the treatment because 
they had recovered [54] . It was found that fewer minutes spent on 
the website and fewer page hits were associated with greater 
symptom reduction [54] . On the other hand, completion of more 
sessions of an internet-based intervention was associated with 
better psychological outcomes in another study [55] . A qualitative 
study suggested that participants are more likely to complete an 
internet intervention when they perceive the treatment as 
beneficial for themselves or for others [22]. Another qualitative 
study on guided iCBT pointed out that there may be subgroups 
who only read the instructions provided in the treatment without 
following them [56], which could indicate that adherence does not 
always equal compliance with the treatment protocol. More 
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research is needed to understand adherence to internet interven- 
tions from the participant's perspective. 

Adherence to face-to-face CBT - comparison with the 
literature 

The adherence rates we found in face-to-face CBT interven- 
tions are in line with previous research. Swift and Greenberg [19] 
found that face-to-face psychotherapy is completed by 80.3% of 
the participants who start the intervention. Moderators that 
resulted in adherence rates slighdy above average included 
cognitive behavioural orientation, individual treatment format, 
and mood disorder as client diagnosis [19]. These findings are in 
accordance with our finding that 84.7% of participants allocated 
to individual face-to-face CBT for depression complete their 
treatment. 

Adherence to face-to-face CBT compared with adherence 
to iCBT 

In terms of clinical effect for depression and anxiety, comput- 
erised interventions and face-to-face interventions tend to be equal 
[57]. Our results indicate that there is also equivalence in the 
percentage of session completion between guided iCBT and face- 
to-face CBT. Little attention was given to session completion in 
previous reviews of studies on internet interventions, except for 
one [18]. Donkin et al. found correlations between clinical 
effectiveness and measures of adherence [18]. While the number 
of logins was correlated with the effectiveness of interventions for 
health problems, session completion was related to the effective- 
ness of interventions for depression and anxiety [18]. This finding 
confirms that if internet-based and face-to-face interventions are 
equal in terms of effectiveness [57], they are likely to be equal in 
terms of adherence as well. 

Our results suggest that non-completers of face-to-face CBT 
complete a smaller percentage of their treatment than non- 
completers of guided iCBT. The absolute number of completed 
sessions of non-completers is likely to be similar, because face-to- 
face CBT treatments consist of more sessions. This indicates that 
participants in face-to-face CBT discontinue their treatment at an 
early stage of the treatment protocol, but if they have completed 
several sessions, they are likely to continue until the end. 
Participants in guided iCBT, on the other hand, drop out more 
gradually over the course of treatment. The reasons for 
discontinuing could be quite different between participants who 
drop out at an earlier stage and participants who drop out at a 
later stage. If a participant discontinues after only one session, the 
intervention may not be the kind of treatment he or she was 
looking for, or it had limited acceptability. If an individual 
discontinues when he or she is already halfway through, (s)he may 
have decided the treatment is no longer needed. It is important to 
note that the guided iCBT interventions in our study are self-help 
courses. Participants in self-help interventions have more control 
over their pace and treatment progress than participants in face- 
to-face therapy, which might explain the difference in adherence 
behaviour. Additionally, factors such as face-to-face contact and 
the anonymity of the internet may be of significance. 

Limitations 

Our findings should be interpreted with some caution. A first 
limitation of our study is that we found no study that directly 
compared guided iCBT with individual face-to-face CBT. The 26 
treatment groups we analysed were described by 24 different 
studies, each with a different design. As has been demonstrated in 
our results, heterogeneity among studies was large. For example, 



participants were administered a diagnostic interview in some 
studies, while other studies included participants based on self- 
report questionnaires. Studies differed not only by design, but also 
by their treatment protocol, e.g. one iCBT intervention could be 
tailored, and seven studies on face-to-face CBT interventions 
defined treatment completion as a range instead of a fixed number 
of sessions. The length of the therapy sessions also differed 
between studies. These factors limit the comparisons in our 
analyses. Secondly, all face-to-face CBT interventions consisted of 
more sessions than the guided iCBT interventions. It is not known 
in what way the length of the programme would affect adherence. 
Although face-to-face CBT interventions are longer, they have the 
same content as guided iCBT, and participants have learned the 
same after completing either of these types of intervention. This is 
underlined by the equivalence in effectiveness [57]. Thirdly, not all 
studies reported all adherence rates, so we could not compare all 
studies in our selection. Some values were estimated to increase 
the number of studies we could analyse. Although our estimates 
were intended to be conservative, we may have overestimated the 
adherence rates of a few studies on face-to-face CBT, as 
mentioned in the methods section of this paper. Participants in 
these studies who completed a substantial part of the intervention 
(e.g. at least twelve of twenty sessions) were defined as completers 
by the respective studies' authors, while exact numbers of sessions 
completed were not provided. We counted these participants as 
full intervention completers for our analyses when other informa- 
tion was lacking. Fourthly, the inclusion criteria of this meta- 
analysis were designed to include the majority of studies on iCBT 
and studies on face-to-face CBT that were similar in design. The 
results of our analyses concerning face-to-face CBT can therefore 
not be generalised to face-to-face CBT in general. For example, 
the adherence to face-to-face CBT could be higher in a sample of 
inpatients. Finally, our results showed a small difference in the 
mean percentage of completed sessions between face-to-face CBT 
and guided iCBT. This difference did not reach significance, 
perhaps because we could not include a sufficiently large number 
of studies. A future meta-analysis that would include more studies 
might show whether our results remain confirmed or whether our 
meta-analysis was underpowered. Still, we can conclude that in 
terms of completed sessions, there is no difference or only a 
marginal difference between guided iCBT and face-to-face CBT, 
at least in community recruited samples. 

Implications and future research 

Adherence is an important measure of acceptability, appropri- 
ateness, and effect of a psychological treatment. Studies on iCBT 
and face-to-face CBT should include more detailed information 
on adherence, preferably both the number of completers and the 
average number of sessions completed. It is recommended to 
include clear instructions for reporting adherence rates in the 
CONSORT statement [58]. Additionally, more research is 
needed on factors that could explain adherence and the 
participants' reasons for dropping out. A meta-analysis of 
individual patient data would enable detailed predictor and 
moderator analyses. Reasons for dropping out can also be assessed 
by qualitative studies [22]. Our results would become more 
meaningful if such data were available. 

Although we found no trial that directiy compared guided iCBT 
with individual face-to-face CBT, our results suggest that the 
adherence to guided iCBT could be adequate compared with the 
adherence to face-to-face CBT. The adherence to guided iCBT 
for depression also appears to be adequate relative to other 
internet interventions. Guided iCBT appears to be an acceptable 
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treatment for depression and efforts should be made to increase its 
implementation. 
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